Search in patchy media: Exploitation-exploration tradeoff
نویسندگان
چکیده
منابع مشابه
Search in patchy media: Exploitation-exploration tradeoff.
How to best exploit patchy resources? We introduce a minimal exploitation-migration model that incorporates the coupling between a searcher's trajectory, modeled by a random walk, and ensuing depletion of the environment by the searcher's consumption of resources. The searcher also migrates to a new patch when it takes S consecutive steps without finding resources. We compute the distribution o...
متن کاملAge differences in information search: An exploration-exploitation tradeoff model
Past research often found that older adults searched less in terms of browsing and generating keywords; few studies examined the processes and underlying mechanism that caused the age-related reduction on search. In the current study, 20 younger and older adults performed ill-defined search tasks with a search box we implemented. In addition to the age differences in the quantities of search, r...
متن کاملAdaptive Exploration-Exploitation Tradeoff for Opportunistic Bandits
In this paper, we propose and study opportunistic bandits a new variant of bandits where the regret of pulling a suboptimal arm varies under different environmental conditions, such as network load or produce price. When the load/price is low, so is the cost/regret of pulling a suboptimal arm (e.g., trying a suboptimal network configuration). Therefore, intuitively, we could explore more when t...
متن کاملOptimal Contraction Theorem for Exploration-Exploitation Tradeoff in Search and Optimization
Global optimization process can often be divided into two subprocesses: exploration and exploitation. The tradeoff between exploration and exploitation (T:Er&Ei) is crucial in search and optimization, having a great effect on global optimization performance, e.g., accuracy and convergence speed of optimization algorithms. In this paper, definitions of exploration and exploitation are first give...
متن کاملExploration-exploitation tradeoff using variance estimates in multi-armed bandits
Algorithms based on upper confidence bounds for balancing exploration and exploitation are gaining popularity since they are easy to implement, efficient and effective. This paper considers a variant of the basic algorithm for the stochastic, multi-armed bandit problem that takes into account the empirical variance of the different arms. In earlier experimental works, such algorithms were found...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Physical Review E
سال: 2017
ISSN: 2470-0045,2470-0053
DOI: 10.1103/physreve.95.012157